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NASA 's Current Uncertain Environment 
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President Bush’ s Proposal in 2Q04 

• Design, develop and fly the Shuttle replacement vehicle (Orion: MPCV) by 2015 

• Return to the Moon around 2020 

• Extend human presence across the solar system and beyond (starting with Mars) 

President Obama’ s Proposal in 2010: 

• Collaboration with commercial sector to develop and operate “taxi services” to low- 
earth orbit (Shuttle replacement) - SpaceX (Falcon 9), Orbital (Taurus II) and others, etc 

• Developing technologies vs. developing systems (NACA) 

- Fund technology aimed at enabling future deep-space exploration systems including new 
types of rocket engines /propulsion, heavy-lift launch vehicles, fueling spacecraft in orbit (on- 
orbit fuelling stations), etc 

- Enhance robotic exploration of space (including precursors to human missions) 


- Research and development of remote autonomous space factories for in-situ utilization 

• Develop a simplified MPCV vehicle to provide multipurpose utility for space 
explorations. Also, use MPCV as part of the technological foundation for advanced 
spacecraft for future deep space missions. 

• Human exploration to asteroids (2025) and eventually Mars (2030s) 


• Foster more International collaboration on future missions/projects (e.g. ISS) 

• Initiate development of a heavy-lift launch vehicle and ready by 2017 
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Upper Stage 
(1 J-2X) 

280k lb LOx/LH 2 


5-Segment 
Reusable Solid 
Rocket Booster 
(RSRB) 


Space Shuttle 

Height: 184.2 ft 
Gross Liftoff Mass: 4.5M lb 


Ares I 

Height: 321ft 

Gross Liftoff Mass: 2.0M lb 


Crew 


Lander 


S-IVB 

(1 J-2 engine) 

240k lb Lox/Lh^ 


S-ll 

(5 J-2 engines) 

IMIb LQx/Lh^ 


S-IC 
(5 F-1) 

3.9M lb LQx/RP 


V 


Saturn V 

Height: 364 ft 
Gross Liftoff Mass: 6.5Mlb 




Dragon 

Volume: 245 ft 3 (pressurized) 
Payload Up Mass: 13Klbm 
Up to 7 crewmermbers 


1 

2 nd Stage 
(1 SpaceX Merlin) 
LQx&RP-l 


1 st Stage 

(9 SpaceX Merlin) 
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Falcon 9 

Height: 180 ft 
Gross Liftoff Mass: 0.7M lb 


55k Ibmto LEO 


48k Ibmto LEO 


99k Ibm to TLI 
262k Ibmto LEO 


23k Ibm to LEO 
10k Ibmto GTO 





Vocabulary 



♦ Extensive list of terms and definitions to establish a 
common vernacular for effective communication and 
management of risk 

♦ Examples: 

■ Risk- A measure of the potential inability to achieve a goal or 
target within defined safety, cost, schedule, and technical 
constraints, It has two components: (1) the likelihood (or 
probability) of failing to achieve a particular outcome, and (2) the 
consequence (or impact) of failing to achieve that outcome. 

■ Risk Management - a process for identifying and mitigating 
threats to achieve safety, cost, schedule, and performance 
requirements. It assists in making decisions on budget and 
resource allocation to meet objectives. 

■ Risk Owner- The individual to whom the risk is assigned for 
purposes of responsibility, authority, accountability and given 
resources to address an assigned risk. Manages, coordinates, 
and tracks the risk mitigation approach and actions 
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NASA Risk Management Principles 



♦ Creates Value 

■ Use risk-informed decision to prioritize strategic and operational decisions 

■ Apply practices to ensure planned objectives & missions are fully achieved 

■ Synthesize projects and allocate risk and organization resources optimally 

- Manage risks by developing comprehensive risk handling to minimize life cycle costs 

♦ Integrated in Organizational Processes 

■ A formally documented risk management process 

- Extensive and Tiered Training 

■ Integrate risk management into overall project management with comprehensive, 
structured and integrated processes 

■ Manage risks at the lowest level possible (where the subject matter experts) 



NASA Risk Management Principles N^SA 

♦ Part of Decision Making 

■ Improve the quality of decision-making throughout the organization 

- Even seemingly insignificant risks on their own have the potential, as they interact 
with other events and conditions to cause great damage. 

■ Risk is a part of every decision made 

■ ISS Vozdukh vs. SM Window Cover Example 

♦ Explicitly Addresses Uncertainty 

■ The uncertainties related to the knowledge and context of the risk 

■ The uncertainties that the risk creates on objectives/goals 

♦ Systematic, Structured and Timely 

■ Require risk identification and management to occur in a tiered, integrated, 
structured manner 

■ Routine risk management at all tiers of the organization 

■ Comprehensive and structured risks identification processes and tools 

■ Proper incentives and disincentives to foster good practices 
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NASA Risk Management Principles 



♦ Based on the Best Available Information 

■ Risk Owners are subject matter experts on the "front lines" 

■ Risk register (database) updated with current information by risk owner 

■ Analyze how individual risks aggregate or are interrelated. Analyze for systemic 
problems and overall trends. 

♦ Takes Human and Cultural Factors into Account 

■ Processes fit culture and organizational structure of NASA 

■ Reinforce the values of radical transparency and continuous improvement. 





NASA Risk Management Principles n^vsa 

♦ Transparent and Inclusive 

■ All team members are responsible for risk management 

- Clearly defined Roles and Responsibilities 

■ Risk meeting/committee are open and free. 

■ Risk database is open (concerns closed) 

■ Accountability - assign risk ownership 

■ Dissenting opinions are encouraged 

- Examples 

♦ Dynamic, Iterative and Responsive to Change 

■ Information is flowed up, resources and prioritizations are flowed down, while 
coordination is made with all responsible stakeholders 

■ Facilitates Continual Improvements and Enhancement of the Organization 

- Remove roadblocks preventing entry into risk management 

- Ongoing monitoring activities are conducted to continually assess risks and risk plans 

- Monitoring and review of risk management effectiveness (metrics) 

- Audit and surveillance (internal and external) 
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Framework 


Mandate & Commitment 

Allocation of Resources 
Setting Goals and Exoectations 
Defining Risk AoDetite 


r 


♦ 


Design of the Framework 

Phased Approach 

Defining reauirements based on Principles 
and needs 

Adjustments to increase effectiveness 
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Continual Improvement of the Framework 

• Internal Assessments of Framework 

• External surveys of best practices 



Implement the Framework 

Ensure implementation 


Monitor, Review and Assess Framework 

Metrics 

Surveys 




Process 



Communicate 

Document 


A 


Plan 



Sources of Risk 


Equipment 

Failure 


External 

Events 


Human 

Errors 


Institutional 

Failure 
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RM Tools & Techniques 


QUANTITATIVE 

♦ Stochastic and Deterministic Modeling 

■ Probabilistic Risk Assessments (PRA) 

■ Other Statistical based Modeling and Analysis techniques 

♦ Cause & Effects Analysis 

■ Failure Modes & Effects Analysis (FMEA) 

■ Fault Tree Analysis (FTA) 

♦ Systems Engineering Analysis and Risk Assessments 

♦ Cost and Schedule Analysis 


QUAUTITATIVE 

♦ Root Cause Analysis 

♦ Hazard Analysis 

♦ Brainstorming 

♦ Process Mapping and Analysis (Humai 
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Risk Coordination and Integration 
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Program Manager 


Project Managers 


Element Managers 


System Managers 



Team Members 










Contractors/suppliers/ vendors 
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ORION [CEV] RISK 


LIKELIHOOD RATING 

5 

Qualitative: Like-y to occur. 

| Very High 

Quantitative: 10' 1 « p (for nsks with primary impact on human safely) or P>50% 
(to- risks wih pnmary impact on cost, scheojle, or performance! 

4 

Qualitative: Probably will occur. 

High 

Quantitative: 10*^ P<10'^ (for nsks with primary impact on human safety! or 

33%<P«£50% (for nsks with primary impact on cost, schedule, or performance; 

3 

CXKwtative: May occur. 

. Moderate 

Quantitative: 1 0“^ <P<10*^ (for risks with pnmary impoct on numan safety, or 
T0^-: P^33% -for risks with pnmary impoct on cost, schedule, or performance! 

2 

Quo'itative: Unlikely to occur. 

Low 

Quantitative: KT* <P<10*3 (for risks with pnmary impact on human safety) cr 
1%< P^10% (for nsks with primary impact on cost, schedule, cr performance! 

1 

Quaiitatr.e: Occurence improbable. 

I Very Low 

Qu antitatr.T Pi_10'^ (for risks with primary impact cn human safety) or 
P^l^ (for nsks with primary impao on cost, schedule, or performance; 




TIMEFRAME 


Near 

0 to 3 months 

Mid 

3 to 9 months 

Far 

> 9 months 


Time to Initiate 
Handling Strategy 


Conseqeuence 1 

Racing Very Low 


Moderate 


Very High 


SAFETY 

Personnel 

A condition that could cause the 
need for minor first aid treatment 
though would not adversely affect 
personal safety or health 
| Class IV) 

A condition that may cause 
minor injury or occupational 
illness. 

(Class III) 

A condition that may cause severe 
injury or occupational illness 
(Class II) 

A condition that may cause 
permanently disabling injury 
(Class l-B) 

A condition that may cause death or 
loss of crew 
(Class l-A| 

Facilities, 
Equipment, or 
Other Assets 

A condition that subjects 
facilities, equipment, or flight 
hardware to more than 
normal wear and fear (Class IV) 

A condition that may cause 
minor property damage to 
facilities, systems, equipment, 
or flight hardware (Class III) 

A condition that may cause major 
property damage to facilities, 
systems, equipment, or flight 
hardware (Class II) 

A condition that may cause 
destruction of non cntical facilities 
or assets 
(Class l-B) 

A condition tha f may cause destruction 
of critical facilities on the ground, 
major systems, or vehicle during the 
mission (Class l-A) 

Environment 

Negligible OSHA/EPA 
violation - non reportable 

Minor reportable OSHA/EPA 
violation 

Moderate OSHA/EPA violation 
which requires immediate 
remediation 

Maior OSHA/EPA violation 
causing temporary stoppage 

Serious or repeat OSHA/EPA violations 
resulting in action terminating proiect 

PERFORMANCE 

(Mission Success) 
Including impacts to 
operations and supportability 

Negligible impact to 
requirements, mission 
objectives or technical goals 

Minor Impact to requirements, 
mission objectives or technical 
goals 

Moderate impact to requirements, 
mission objectives or technical 
goals 

Major impact to requirements, 
mission objectives or technical 
goals 

Technical goals not achievable with 
existing engineering capabilities/ 
technologies 

COST 

<S100K 

(Negligible impact to budget) 

>S1 00K but <S1M 
(Minor impact to budget) 

>$1M but <S10M 
(Moderate impact to budget) 

>S10M but <$50M 
(Major impoct to budget) 

>S50M 

(Possible project cancellation) 

SCHEDULE 

Negligible schedule impact 

Minor overall schedule impact 
(Accommodate with reserve, no 
impact to critical path) 

< 1 month impact to critical path/ 
milestones 

>1 and <5 month impact to 
cntical path/milestones 

>5 month impact to cntical path/ 
milestones or possible 
project cancellation 


September 2CQ^0 








Organizational Culture & Risk 

Management 



♦ Organization’ s culture not only consists of interlocking set of goals, roles, processes, 
values, communications practices, attitudes and assumptions, but also many nebulous 
and dynamic elements 

■ Changing organizational culture is one of the most difficult things to change 


♦ Fundamental elements in changing organizational culture 




Where are you now: understand the current culture. 


Where do you want to be: decide where it wants to go, define its strategic direction, 
and decide what the organizational culture should look like to support success. What 
vision does the organization have for its future and how must the culture change to 
support the accomplishment of that vision? 

Is there a road there: the organization’ s people must decide to change their 
behavior to create the desired organizational culture. 


Cognitive - people must have some understanding of why the change in strategy or in 
culture is needed. 

Motivation - ultimately, workers have to want to make the change 
(incentives/disincentives). 




Culture 


♦ Reporting Culture: We report our concerns. Identification of hazards or safety concerns is 
encouraged, including a system that's easy to use. The reporting system maintains anonymity 
and is separate from the disciplinary processes. Useful feedback based on reporting is quick and 
insightful. An atmosphere of trust exists between managers and workers, with employees 
knowing important information will be voiced, heard, and acted on appropriately. 

♦ Just Culture: We have a sense of fairness. People are held accountable for deliberate violations 
of rules and recognized for outstanding performance. There's a clear understanding of 
acceptable and unacceptable behaviors. There's a sense of fairness about how business is 
conducted, where people aren't punished for reporting and aren't afraid of reprisal if they do. 

♦ Flexible Culture: We change to meet new demands. The organization effectively balances and 
adapts to changing demands. A healthy flexible culture uses safety data to make meaningful 
changes when there's a concerning trend or issue. 

♦ Learning Culture: We learn from our successes and mistakes. Collecting, assessing, and sharing 
from experience is a priority. Information is available to everyone from novice to expert. Values 
and commits to proactively "learn from our mistakes," both formally and informally. 

♦ Engaged Culture: Everyone does their part. All members regardless of status or occupatioi 
involved and actively participate in safely accomplishing the mission. The key is to have leaders 
and employees who demonstrate they value safety by "walking the talk." 







Risk Management Lessons Learnt 



♦ Risk management supported by leadership, team members and 
stakeholders and active involvement by all 

■ Uses it and promotes it 

♦ A well defined, structured and understood risk management processes and 
tools 

■ All team-members are expected to participate in risk management 

■ A formally documented risk management process 

■ A proactive risk training program 

- Not overly complex, must be understood and used (minimize overhead & foster 
adherence) 

■ Comprehensive and structured risks identification processes and tools 
(Establish risk toolbox for identifying and analyzing risks) 

■ Proper incentives and disincentives to foster good practices 

■ Phased implementation approach 

♦ Continuous and iterative assessment of risks 

■ Provide elements of independence of the risk analysis function from the 
program/project 





Risk Management Lessons Learnt 

Integrated with program/project decision-making processes (RIDM) 

■ Continuous, event-driven technical reviews (incl project milestones) to help 
define a program that satisfies the customer’ s needs within acceptable risk 

■ Continuous prioritization, assessments and mitigation planning and 
appropriate funding 

Risk management integral to the acquisition process 

A continuous process improvement strategy that monitors and improves 
risk management processes and tools 

Weaving Risk Management into the cultural fabric of the organization is 
critical, but difficult 



Summary 



♦ Phased-approach for implementation of risk management is necessary 

♦ Risk management system will be simple, accessible and promote 
communication of information to all relevant stakeholders for optimal 
resource allocation and risk mitigation 

■ Risk management should be used by all team members to manage risks - not 
just risk office personnel 

■ Each group/department is assigned Risk Integrators who are facilitators for 
effective risk management 

■ Risks will be managed at the lowest-level feasible, elevate only those risks 
that require coordination or management from above 


Risk informed decision making should be introduced to all levels of 
management 

Provide necessary checks and balances to insure that risks are 
caught/identified and dealt with in a timely manner 

Many supporting tools, processes & trai 
effective risk management imple 

Process improve 
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